Convergence of The Relative Value Iteration for the Ergodic Control Problem of Nondegenerate Diffusions under Near-Monotone Costs
نویسندگان
چکیده
We study the relative value iteration for the ergodic control problem under a nearmonotone running cost structure for a nondegenerate diffusion controlled through its drift. This algorithm takes the form of a quasilinear parabolic Cauchy initial value problem in R. We show that this Cauchy problem stabilizes, or in other words, that the solution of the quasilinear parabolic equation converges for every bounded initial condition in C(R) to the solution of the Hamilton– Jacobi–Bellman (HJB) equation associated with the ergodic control problem.
منابع مشابه
A Correction to "A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions"
In A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions, [SIAM J. Control Optim., 50 (2012), pp. 1886–1902], convergence of the relative value iteration for the ergodic control problem for a nondegenerate diffusion controlled through its drift was established, under the assumption of geometric ergodicity, using two methods: (a) the theory of monotone dynamical systems an...
متن کاملA Correction to “A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions'' | SIAM Journal on Control and Optimization | Vol. 55, No. 3 | Society for Industrial and Applied Mathematics
In A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions, [SIAM J. Control Optim., 50 (2012), pp. 1886–1902], convergence of the relative value iteration for the ergodic control problem for a nondegenerate diffusion controlled through its drift was established, under the assumption of geometric ergodicity, using two methods: (a) the theory of monotone dynamical systems an...
متن کاملConvergence of the Relative Value Iteration for the Ergodic Control Problem of Nondegenerate Diffusions
We study the relative value iteration for the ergodic control problem under a nearmonotone running cost structure for a nondegenerate diffusion controlled through its drift. This algorithm takes the form of a quasi-linear parabolic Cauchy initial value problem in Rd. We show that this Cauchy problem stabilizes or, in other words, that the solution of the quasi-linear parabolic equation converge...
متن کاملA Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions
Abstract. The ergodic control problem for a non-degenerate controlled diffusion controlled through its drift is considered under a uniform stability condition that ensures the well-posedness of the associated Hamilton–Jacobi– Bellman (HJB) equation. A nonlinear parabolic evolution equation is then proposed as a continuous time continuous state space analog of White’s ‘relative value iteration’ ...
متن کاملOn the policy iteration algorithm for non-degenerate controlled diffusions under the ergodic criterion
The subject of this paper is the policy iteration algorithm for non-degenerate controlled diffusions. The results parallel the ones in Meyn [11] for discrete-time controlled Markov chains. The model in [11] uses normlike running costs, while we opt for the milder assumption of near-monotone costs. Also, instead of employing a blanket Lyapunov stability hypothesis, we provide a characterization ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- SIAM J. Control and Optimization
دوره 52 شماره
صفحات -
تاریخ انتشار 2014